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(54) Entity retrieving system and method for retrieving entities 



(57) The present invention relates to an entity re- 
trieving system and a method for retrieving entities. The 
system and method according to the invention compris- 
es mutation means provided for cooperating with a 
memory, a processor and an interface and for establish- 
ing, for each particular entity to be retrieved upon re- 



quest of a user, if said particular entity pertains to a de- 
pendent classes of the class identified by the user and 
retrieving, upon establishing that said particular entity 
pertains to one of said dependent classes of said select- 
ed particular class, said additional properties of said de- 
pendent class. 
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Description 

The present invention relates to an entity retrieving 
system connectable to at least one data source, said 
system having a memory into which a plurality of classes 
are stored, each class defining the structure of said en- 
tities, said structure comprising a plurality of property 
definitions, each property definition identifying property 
values to be retrieved dedicated to said property defini- 
tion, said property values being stored in said data 
sources, said system further comprising an interface 
and a processor connected to each other, wherein : 

(a) said classes comprise at least one dependent 
class hierarchically linked to at least one other 
class, said dependent class comprising additional 
property definitions specifying additional property 
values, in addition to the property values of the 
classes from which it depends, 

(b) said interface is provided for receiving a query 
and supplying said query to said processor, said 
query comprising an identifier for identifying a par- 
ticular class and at least one of said property values, 

(c) said processor being provided, under control of 
said query, for selecting, among said classes, said 
particular class dedicated to said identifier, and 

(d) said interface is further provided : i) for access- 
ing said data sources, under control of said proces- 
sor; ii) for retrieving property values pertaining to at 
least one particular entity that comprise said at least 
one of said property values; and iii) for outputting 
the retrieved entities. 

Such a system is known from US patent 5,560,005, 
which enables to transform entities stored in a plurality 
of remote, heterogeneous structured relational databas- 
es into a homogeneous data model. In this patent, sev- 
eral classes are defined, e.g. "SERVICE PROVIDER" 
forming an abstract class and "HOSPITAL", "PHYSI- 
CIAN" and "PRACTISE" forming derived base classes 
or dependent classes hierarchically linked to the 
"SERVICE PROVIDER" class. Classes dependent from 
the dependent classes may also occur. This forms an 
hierarchic modelled structure of the classes into which 
property values or data may be incorporated. A query 
supplied by a user to the known system is formed by a 
request comprising the class name and search argu- 
ments forming thus the identifier to be supplied to the 
system. The system searches in the remote databases 
the table entries matching the provided search argu- 
ments and returns the property values of the table en- 
tries to the requester. 

A problem with the known system is that the system 
will return a number of data, from the found particular 
entities, i.e. only the properties to be incorporated in that 
particular class. This means that if the user selects a 
particular class and the entity to be returned belongs in 
fact to a dependent class hierarchically dependent from 



the particular class, the number of properties returned 
to the user will be limited to the properties to be incor- 
porated in that particular class. If the user wants to check 
if a particular entity pertains to a dependent class, he 
5 has to supply an additional query to the system, wherein 
the particular dependent class is mentioned. The more 
dependent classes there are and/or the more entities 
are found, the more time consuming this checking op- 
eration will be. 

10 This problem is solved in the system according to 
the invention, which system further comprises mutation 
means provided for cooperating with said memory, said 
processor and said interface and for establishing, for 
each particular entity to be retrieved, if said particular 

75 entity pertains to one of said dependent classes of said 
selected particular class, and retrieving, upon establish- 
ing that said particular entity pertains to one of said de- 
pendent classes of said selected particular class, said 
additional properties of said dependent class. In case a 

20 user requests now for entities belonging to a particular 
class, the mutation means of the system will check if the 
found entity also pertains to one of the dependent class- 
es of the particular class and, if this is the case, return 
the additional properties to be incorporated to the de- 

25 pendent class. The answer to the request of the user 
will therefore be more complete than expected, without 
requiring the userto manually check if the entity belongs 
to a particular class. 

Preferably, agents are stored in the memory of the 

30 system, each agent being dedicated to at least one of 
said classes, each agent being provided for cooperating 
with said interface for accessing at least one particular 
property value pertaining to said particular entity of said 
class, each agent comprising : (a) an address for ad- 

35 dressing one of said data sources from which said par- 
ticular property values are to be retrieved; (b) a series 
of instructions indicating which data from the addressed 
data source are to be retrieved by said agent; and (c) at 
least one agent parameter for assigning, for each prop- 

40 erty value to be retrieved, a portion of said data to one 
of said property definitions. In particular, a reliability pa- 
rameter is assigned to said agent. 

Such a reliability parameter enables to indicate how 
trustworthy the addressed data source is. In case for ex- 

45 ample a first agent retrieves a first entity and a second 
agent retrieves a second entity, wherein the first entity 
is identical to the second entity except for one or more 
property values that are not equal to each other, the sys- 
tem may then, based on the reliability parameter of the 

50 agents, decide that one data source has provided a 
wrong property value or that there is one entity with an 
uncertainty concerning the property values that do not 
correspond or that those two entities in fact refer to two 
different entities. 

55 According to a preferred embodiment, said system 
further comprises means for displaying the retrieved en- 
tities to a user and means for generating, upon receipt 
of said retrieved entities, at least one list, each list com- 
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prising a plurality of property value ranges for subdivid- 
ing said retrieved entities, and said interface is further 
provided for enabling said user to select one property 
value range within one of said lists. 

Such lists are very convenient when a iarge number 
of entities have been retrieved by the system. With 
known systems, the user would have to scroll through 
the results, without having an idea how the entities are 
structured. In this case, a logical structure of the re- 
trieved entities is presented to the user, wherein the user 
can select a range. The entities belonging to that range 
will be shown to the user. This system enables thus to 
the user to view the results in a more structured way. 

The present invention further relates to a method 
for retrieving entities by using a system according to an- 
yone of the preceding claims comprising the steps of : 
a) receiving said query and supplying said query to a 
processor; b) selecting among said classes, said partic- 
ular class dedicated to said identifier, c) accessing said 
data sources, under control of said processor, d) retriev- 
ing property values pertaining to at least one particular 
entity that comprise said at least one of said property 
values and e) outputting the retrieved entities. Accord- 
ing to the invention, said method further comprises the 
step of establishing, for each particular entity to be re- 
trieved, if said particular entity pertains to one of said 
dependent classes of said selected particular class, and 
for retrieving, upon establishing that said particular en- 
tity pertains to one of said dependent classes of said 
selected particular class, said additional properties of 
said dependent class. 

The invention will now be described with reference 
to the annexed drawings, wherein : 

Figure 1 illustrates schematically a preferred em- 
bodiment of the entity retrieving system according to the 
present invention. 

Figure 2 illustrates schematically from which data 
sources the entities may be retrieved by the entity re- 
trieving system according to an alternative embodiment 
of the present invention. 

Figure 3 illustrates a database structure according 
to a preferred embodiment which is used for implement- 
ing the system according to the present invention. 

Figure 4 illustrates an example of a number of class- 
es with their hierarchy. 

Figure 5 illustrates an example of the attributes and 
contents of a class 

Figure 6 illustrates an example of an entity of the 
class according to Figure 5. 

Figure 7 illustrates an example of agents returning 
inconsistent and ambiguous property values. 

Figure 8 illustrates a display supplied to the user 
when a relatively large number of entities are retrieved 
by the system according to the present invention. 
Figures 9 to 11 illustrate examples of agents. 
As illustrated in Figure 1, the entity retrieving sys- 
tem 100 according to the present invention comprises 
a bus 102 to which a memory 105, an interface 111 and 



a processor 104 are connected. In particular, the mem- 
ory is formed by a main memory 106, such as a random 
access memory (RAM), a read only memory (ROM) 1 08 
and a storage device 110, such as a magnetic disk or 
s optical disk. The interface comprises a display 112 for 
showing the retrieved entities to a user, an input device 
1 1 4 such as a keyboard enabling a user to input a query, 
a communication interface 118 and optionally a cursor 
control 116 such as a mouse. 
70 The system according to the invention is connecta- 
ble to data sources, which may be internal to the system, 
for example data sources stored in the memory 105, 
and/or external to the system. For external data sourc- 
es, use is made of the communication interface 118 for 
is connecting the external data source to the system. Data 
sources may be located in a host device 1 24, connected 
to the system through the intermediary of the local net- 
work 1 22 and a network link 1 20. Data sources may fur- 
ther be stored in a server 1 30 connected to the network 
20 122 through the intermediary of a communication net- 
work such as the Internet 128 which is accessible via 
an internet service provider (ISP) 126 or the like. 

Figure 2 shows an entity retrieving system 100 ac- 
cording to an alternative embodiment, wherein data 
25 sources are stored. The retrieved entities may be rep- 
resented to a plurality of user using a personal computer 
240 with a user interface, in particular a web browser. 
The personal computers are connected, through the in- 
termediary of network 122 to a network computer 1 26, 
30 in particular a web server, enabling a connection to the 
internet 1 28. The network computer comprises a mem- 
ory 1 05 into which several databases are stored, for ex- 
ample spreadsheets 242, internal web sites 244 or other 
databases 246. External data source formats may be 
35 formed by external databases 257, telnet sites 267 or 
public web sites 277, stored in respective memories 
255, 265 and 275 in respective computer systems 250, 
260, 270. It is also conceivable, according to another 
embodiment of the present invention, to have for exam- 
40 pie video or sound data sources. The entity retrieving 
system of the present invention may be applied for re- 
trieving entities stored in data sources having different 
formats, such as will be described further. 

Referring to Figure 3, there is shown a possible da- 
45 tabase structure used when implementing the entity re- 
trieving system according to the present invention. It 
forms a structured generic model or a so called "meta 
model" of a specific modelled structure, an example of 
which will be described when referring to Figures 4 to 6. 
50 it should be clear that this relational database structure 
is only one possible way to implement the present in- 
vention. In Figure 3, there are shown a number of tables, 
each table having a number of fields, each field defining 
a certain function. Many to one relationships between 
55 the fields are indicated by interconnecting lines with an 
indication '«»" on the many side and "1 B on the one side. 
For example, instances 215 may have many attributes 
211 . Accordingly, there is an indication '«•" on the many 
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side of the Instance field 21 1 -1 and an indication "1 " on 
the one side of the Instance field 215-1. 

In Figure 3, distinction is made between a concep- 
tual layer 220 forming an intermediary between a data 
layer 210 and a visualisation layer 230. 

CONCEPTUAL LAYER 

The conceptual layer 220 comprises fields describ- 
ing how data is organised within a defined model. The 
main part of the conceptual layer 220 is formed by the 
classes 225. A class 225 pertains to a model 224. The 
model table enables to support multiple models and de- 
pendent models. A specific model might be composed 
of a plurality of dependent models. For example, a bank- 
ing model might have an accounting and a lending de- 
pendent model. The model table 224 comprises fields 
with the following meaning : 

224-1 Model is a unique identifier, in particular a 
number for identifying the model. For exam- 
ple, the banking model has number "1001", 
the accounting "1101" and the lending model 
"1102" 

224-2 Name indicates the name of the model in a 
human readable manner. In the example giv- 
en above, this field would for example be 
"banking", "accounting" and "lending". 

224-3 Container : If the model is a dependent model, 
this field contains the unique identifier of the 
model from which it depends. For example the 
"accounting" model would have in this field 
the unique identifier of the banking model, i. 
e. "1001". It should be clear that a dependent 
model may be dependent of a dependent 
model. For example, the accounting model 
may comprise several dependent models, 
which would have in this field the number 
"1101". 

224-4 Author indicates the name or a user ID of the 
person that created this model. 

224-5 Origin : If this model has been imported from 
a data source, the address of the data source 
is indicated here. In case the data source has 
been accessed through the Internet, it would 
be an URL. 

224- 6 Date Created indicates the creation date of 

the model. 

Each model 224 has at least one class 225. Each 
class 225 is provided for defining the structure of entities 
to be retrieved. The class table 225 comprises the 
fields : 

225- 1 Class is a unique identifier for identifying the 

class, in particular a number. 
225-2 Name is another unique identifier for the class 
but in a format convenient for human use. In 



particular it is formed by a string of characters, 
e.g. "book 8 or "product". 
225-3 Description is provided for enabling the oper- 
ator maintaining the system to add annotation 
s and comments for this class. 

225-4 Life Span indicates how long, lor example in 
seconds, the entities bebnging to that class 
should be kept in the memory of the system. 
For example a class in which the price of the 
10 entities is retrieved should have a relatively 

short life span, whereas a class from which 
the data is not quickly outdated may have a 
longer life span. 
225-5 Remote server : In case a class is defined in 
is another model and/or in a remote data 

source, the address of this model / data 
source is mentioned in this field. 
225-6 Model contains the model unique identifier 
224-1 to which the class is dedicated. 
20 225-7 Seed indicates an Attribute Definition unique 
identifier, which is the attribute field 221-1 as 
will be described further, indicating which val- 
ue is unique for each instance in the class. For 
example, a book may have as unique value 
25 its ISBN or ID number. 

Each class can have a plurality of dependent class- 
es or can be a dependent class from a plurality of class- 
es. For this purpose, an Is A table 229 is provided for 
30 defining the hierarchy. It comprises the fields : 

229-1 Superclass comprising the unique identifier of 
a class, 

229-2 Subclass comprising the unique identifier of a 
35 dependent class of the superclass identified 

in field 

229-3 Level showing the number of intermediate 
classes between the superclass 229-1 and 
the possibly indirect subclass 229-2, wherein 
40 level 0 indicates that the superclass and sub- 

class are equal, level 1 indicates that subclass 
is a direct dependent class of the superclass, 
level 2 indicates that there is one intermediate 
dependent class between the subclass 229-2 
45 and the superclass 229-1, etc.; this multiple 

level architecture improves the performance 
of the system and 
229-4 Mutative indicating whether or not one or 
more mutation patterns or agents are dedicat- 
50 ed to the class. 

Each class has a plurality of attribute definitions. 
The attribute definitions table 221 comprises property 
definitions, with the following fields : 

55 

221-1 Attribute is a unique identifier for an attribute 

definition, eg. a number 
221-2 Class identifies the class 225-1 that contains 



225-3 

5 

225-4 

10 

225-5 

75 

225-6 
20 225-7 

25 
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40 
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229-4 

so 



5 



BNSDOCID: <EP 0883063A2_I_> 



7 



EP 0 883 068 A2 



8 



this attribute as part of its structure 
221 -3 Name is an identifier of the attribute in text for- 
mat 

221 -4 Default Class is an identifier of another class 
if the property contains a reference to this oth- 
er class. For example a supplier attribute in a 
product class could refer to a supplier class. 

221-5 Default Value comprises a default value in 
case the property value for this attribute is not 
found. 

One or a plurality of mutation patterns can be ded- 
icated to each class. The mutations table 223 comprises 
mutation pattern portion with one condition, for example 
book's pages is greater than or equal to 50. A mutation 
pattern may be formed by a plurality of conditions each 
condition being defined in a mutation pattern portion, for 
example book's pages is greater than or equal to 50 and 
price is less than $10. This table comprises the fields 

223-1 Class is the identifier of the class 225-1 to 
which the mutation pattern element is dedicat- 
ed 

223-2 Attribute is the identifier of the attribute 221 -1 

on which a condition applies, for example the 

attribute pages 
223-3 Condition is an operator for example "greater 

than or equal to", "equal to", "not equal to", ... 
223-4 Value is the value to which the property value 

should be compared, for example ■50" 

One or a plurality of agents can be dedicated to 
each class. The agents table 227 comprises the follow- 
ing fields : 



227-7 
227-8 

5 

227-9 
10 227-10 



15 



20 



227-1 1 

227-12 
227-13 

227-14 



25 227-15 



Time Out indicates how long an agent should 
wait when the data source is not responding 
Confidence indicates how trustworthy the 
property values retrieved from the data 
source (see origin 227-13) is 
Local indicates whether or not the agent is lo- 
cal; if an agent is local then the agent is only 
used for the class to which it is dedicated, not 
in its dependent classes 
Disabled indicates whether the agent is not to 
be used. This field is used for debugging and 
diagnostic purposes 

Authoritative : if this field is yes and if this 
agent receives an empty response to its re- 
quest, then the entity does not exist 
Mutator indicates whether this agent is a mu- 
tation agent 

Origin indicates the data source identity, in 
particular the path name of the data source 
from which the property values are to be re- 
trieved 

Content Class identifies the class 225-1 of the 
references returned by the agent, if the agent 
is a content agent. 

Code comprises the instructions, forming a 
parameterised query, to be executed when 
running the agent 



30 



When an agent applies the code 227-1 5, data is re- 
turned comprising the requested property values. Each 
property value has to be extracted as a portion of the 
returned data. For this purpose, agent parameters are 
dedicated to the agent. The agent parameters table 228 
comprises the fields : 



35 



227-1 ID is a unique machine readable identifier for 
the agent 

227-2 Class identifies the class to which the agent 
is dedicated 

227-3 Sequence is a number defining sequential or- 
der of invocation of the agents for a class (op- 
tional) It defines the agent's priority. If two 
agents are ready to be run, the one with the 
greater priority has precedence. The lower 
the sequence, the greater the priority. 

227-4 Description is an annotation for providing a 
human readable description of the agent 

227-5 Type specifies whether the agent is an at- 
tribute agent or a content agent. An attribute 
agent is provided for retrieving attributes while 
a content agent is provided for retrieving con- 
tents. The difference between contents and 
attributes is explained further when referring 
to the attributes and contents tables 211 and 
213. 

227-6 Specialty specifies the nature of the data 
source the agent queries, e.g. ODBC, Web, 
Corba, Telnet 



228-1 



228-2 



40 



45 



50 



228-3 



55 228-4 



Agent identifies the agent 227-1 to which the 
agent parameter is dedicated. 
Key is a field dependent of the specialty 227-6 
of the agent; 

for ODBC agents, key is an index (e.g. 
1 ,2 ; 3,...) assigned to each portion of data re- 
turned by a query; 

for Web agents, key is the identifier of the 
property definition to which the portion of data 
will be assigned 

Value is a field dependent of the specialty 
227-6 of the agent; 

for ODBC agents, value is the identifier of the 
property definition to which the portion of data 
identified by the key field will be assigned 
for Web agents, value is the pattern used for 
identifying the portion of data to be extracted 
and assigned to the property definition indi- 
cated by the key field 228-2 
Type is a field dependent of the specialty 
227-6 of the agent; 

for ODBC agents, this field is not used for Web 
agents, type is a code indicating whether to 
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perform pattern matching on the HTML or on 
the text without the HTML tags. 

For the purpose of clarity, an example of agents with 
parameters is given in Figures 9 to 1 1 , wherein the ref- 
erence numbers indicate in which field from Figure 3 the 
values are stored. Figure 9 gives an example of an at- 
tribute agent with specialty "ODBC", figure 10 a content 
agent with specialty "ODBC" and figure 11 an attribute 
agent with specialty "WEB". The fields provided below 
specialty are shown in function of the selected type and 
specialty. 

VISUALISATION LAYER 

The visualisation layer 230 is provided for compris- 
ing data from which a predetermined presentation of an 
entity is selected and produced. A view is here defined 
as what a group of users is allowed to see; it is repre- 
sented as a set of templates attached to classes. It 
should be noted that some classes can have no tem- 
plate for a given view, meaning that the user has no ac- 
cess to the data requested or that there is a view to be 
inherited from one classes from which the dependent 
class depends, or that a default view has been assigned. 

A class view table 233 is provided for determining 
a single template given a view and a class, or a single 
view given a template and a class or a list of classes 
given a template and a view This table comprises the 
fields : 

233-1 Class View is a unique identifier, e.g. a serial 
number, for a class view 

233-2 Class is the unique identifier of the Class 
225-1 to which the class view is dedicated 

233-3 View is the unique identifier of the View 239-1 
to which the class view is dedicated 

233-4 Template is the unique identifier of the Tem- 
plate 235-1 to which the class view is dedicat- 
ed 

To each class view one ore more class view map- 
pings can be dedicated. The class view mappings table 
231 holds variable substitution data. When a template 
is processed, for example as HTML or VRML genera- 
tion, "value holders" such as "%supplier" are substituted 
by their values. A value holder can refer by name either 
to a class defined attribute, a class view mapping vari- 
able or a template variable. An attribute has precedence 
over a class view mapping variable which has prece- 
dence over a template variable. In other words, the val- 
ue of a value holder in a template will default to the value 
of a template variable only as a last resort. The class 
view mappings table comprises the fields : 

231 -1 Class view is a unique identifier of the Class 
View 233-1 to which the class view mapping 
is dedicated. 



231 -2 Name is the name of the variable, for example 
supplier. 

231 -3 Expansion is a value of a variable, in particular 
a template. 

5 

Class views are dedicated to views. The view table 
239 comprises the definition of a view. A view represents 
what a group of users is allowed to see. A view is a set 
of templates assigned to classes. Each template is re- 
io trievable from the class view table : given the view and 
a class. The view table comprises the fields : 

239-1 View is a unique identifier for the view. 
239-2 Name is the name of the view, for example 
15 "Inventory managers" 

239-3 Description is provided for holding annota- 
tions 

239-4 Links is the text of a default link template for 
the view, which is used when no template of 
20 ihe type link (see 235-3) has been dedicated 

to a view. 

239-5 Generic template is a number identifying a de- 
fault template 237-1 used when more than 
one entity is found; although the user has re- 

2S quested for one entity, for example one book; 

this can occur when there is a "conflict of opin- 
ion' as will be explained further. 
239-6 Authentication indicates the name of a user's 
group if the present view is restricted to par- 

30 ticular users. A password could be requested 

for some particular views. This password pro- 
tection of views is performed with techniques 
known as such. 

35 Each class view is dedicated to a template. The 
templates table 235 comprises data related for produc- 
ing a presentation of an instance of a class, for example 
HTML, XML or VRML presentations. This table compris- 
es the fields : 

40 

235-1 Template is a unique identifier for a template 
235-2 Name is a text indicating the name of the tem- 
plate 

235-3 Type indicates the type of the template, for ex- 
45 ample an object template (in particular an 

item), a space template (in particular a page), 
a link template (for representing a value of an 
attribute, in particular a hyperlink), ... 
235-4 Specialty determines the presentation medi- 
50 um : for example HTML, VRML XML, ... 

235-5 Description enables the manager of the sys- 
tem to add comments and annotations 
235-6 Content gives the actual text of the template, 
with embedded value holders 
55 235-7 Extent indicates spatial dimensions for three 
dimensional objects or spaces for VRML 
presentations 
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Each template may comprise a number of template 
attributes. The template attributes table 237 comprises 
template variables used in value substitution, as ex- 
plained with reference to the class view mappings table 
231 . The template attributes table comprises the fields : 

237-1 Template is the unique identifier of the tem- 
plate 235-1 to which the template attribute is 
dedicated 

237-2 Name identifies the name of the variable 
237-3 Default value comprises, if applicable a de- 
fault value of that variable 

DATA LAYER 

In order to improve response time, instances or en- 
tities retrieved by the system according to the present 
invention are preferably cached. The content and at- 
tributes of instances are stored separately. This enables 
to cache for example the attributes of an instance and 
not its contents or vice versa. An instance is cached no 
longer than is permitted by its class's life span 235-4. 

The instance table 215 is provided for holding the 
instances or entities cached by the system according to 
the present invention. This table comprises the fields : 

215-1 Instance is a unique identifier of an instance 
215-2 Class is the identifier of the class 225-1 to 

which the entity or instance pertains 
215-3 Expiration indicates the moment when a 
cached instance expires. This moment is cal- 
culated on the moment the data is retrieved 
plusthe life span indicated in the life span field 
225-4. 

215-4 Agent state is a list of agent identifiers 227-1 
that were used for retrieving the cached con- 
tents or attributes of an instance. 

The contents table 213 comprises the content, re- 
trieved by means of a content agent, of cached instanc- 
es. A content is a list of references to instances of a giv- 
en class. The content table comprises the fields : 

213-1 Instance is the identifier 215-1 of the cached 
instance to which the content pertains 

21 3-2 Class is the identifier of the class 225-1 ol the 
cached content 

213-3 Seed is a value from a list of values that 
makes up the content of an instance, that, to- 
gether with the content class, specifies an in- 
stance of that class. The content seeds form 
a portion of property values to be retrieved. 

The attributes table 211 comprises the attributes, 
retrieved by means of a content agent, of cached in- 
stances. This table comprises the fields : 

211-1 Instance is the identifier 215-1 of the cached 



instance to which the content pertains 
213-2 Attribute is the identifier of the attribute defi- 
nition 221 -1 to which the cached attribute per- 
tains to 

5 21 3-3 Seed is the cached vaiue or property value of 
the attribute. 

Figure 4 illustrates an example of a store model 
having a plurality of classes : "PRODUCT 1 , "BOOK", 
10 -AUDIO TAPE" and "BEST-SELLER". Classes "BOOK" 
and "AUDIO TAPE" are dependent classes from the 
"PRODUCT" class. A best-seller is a particular book. 
Therefore, the "BEST-SELLER" class depends from the 
class "BOOK". In case a class "VIDEO TAPE" has to be 
is added to the store model, it can easily be added as a 
dependent class of the "PRODUCT" class. 

Each class has a number of property definitions, in 
particular attribute and content definitions. Referring to 
Figure 5, the "PRODUCT" class has for example the at- 
20 tribute definitions 221 with name 221-3 "ID", "SUPPLI- 
ER" and "TYPE", wherein ID is a unique identifier for a 
particular product, the supplier attribute is a reference 
to a supplier from the "SUPPLIER" class, and type de- 
scribes the type of the product. ID and Type identify 
25 property values for simple data, e.g. numbers or strings, 
whereas Supplier identifies a property value referring to 
another entity, e.g. a Supplier entity pertaining to the 
Supplier class. The default class 221-4 field for this 
property definition will therefore be "SUPPLIER". The 
30 "BOOK" class is a dependent class from the "PROD- 
UCT" class and inherits therefore all the property defi- 
nitions from the classes from which it depends. In addi- 
tion, it comprises additional property definitions, such as 
illustrated in Figure 5, i.e. the attributes "Title", "Author" 
35 and the contents "EDITION", "REVIEW", "CHAPTER 1 ", 
"CHAPTER 2°. 

Attributes are "single-valued" in the sense that each 
attribute has only one value. The title of a book is a single 
piece of data. Content properties, on the other hand, re- 
40 fer to open-ended lists of or references to other entities. 
For example, Chapters and Reviews are content prop- 
erties of a book; they list the book's chapters and re- 
views. Content properties can also be inherited. For ex- 
ample, the Sales content property of a Book could be 
45 inherited from Product. 

Figure 6 illustrates an example of a book entity hav- 
ing the following property values: "93-21123" as ID, 
"Doubleday" as Supplier, "Book" as Type, "War & 
Peace" as Title and "Tolstoy, Leo" as Author. The con- 
so tent properties refer to other entities. This entity is found 
by the system according to the invention after the user 
has input a request, for example : 

http://www.server.com/query.pl7Prod- 
uct=93-21123&View=Customer For such a query, it is 
ss assumed that a product can only be retrieved based on 
its ID number. In this case, the seed field 225-7 would 
indicate the unique identifier of the attribute definition 
for ID number. The search possibilities could be en- 



8 



BNSDOCID: <EP 088306BA2_I_> 



13 



EP 0 883 068 A2 



14 



hanced by permitting to indicate in a query any property 
value pertaining to a class. The request would have then 
for example the following format : 

http://www. server.com/query.pl? Product 
ID=93-21 123&View=Customer 

The interface 111 receives this query and supplies 
it 1o the processor 104 of the system. The processor will 
select from the memory the "Product" class, since the 
user has keyed in Product as particular class. An agent 
dedicated to the Product class, is provided for retrieving 
the Supplier and Type property values based on the ID 
number. These property values are for example stored 
in an internal data source, for example a relational da- 
tabase 246 (see Figure 2). The agent comprises an ad- 
dress in field Origin 227-13 indicating the path name of 
the database 246 data source. In order to enable to re- 
trieve data from different types of data sources, there 
are provided different types of agents. For a relational 
database such as Oracle ®, the agent is an ODBC agent 
type. The agent further comprises a series of instruc- 
tions indicating which data from the addressed data 
source are to be retrieved by the agent, for example : 
"Select Key, Type, Supplier FROM Products" 

The agent further comprises in its agent parameters 
228 for assigning, for each property value to be re- 
trieved, a portion of the data to one of the property def- 
initions. In this case, "Key" is assigned to °ID" property 
definition, "Type" to "Type" property definition and "Sup- 
plier" to "Supplier" property definition. 

This agent co-operates with the interface 1 1 1 for ac- 
cessing the data source, under control of the processor 
104 and for retrieving the requested data. In the exam- 
ple mentioned hereinabove, the following data will be 
returned : "93-21 123" forming the ID, "Doubleday" form- 
ing the Supplier and "Book" forming the type. This data 
is stored in the memory of the system and will be pro- 
vided to the user such as in known entity retrieving sys- 
tems. 

According to the invention, the system further com- 
prises mutation means. The system will in particular 
check if mutation patterns or mutation agents are dedi- 
cated to one of the dependent classes. This can in par- 
ticular be performed by verifying, for each dependent 
class, if the mutative field 229-4 is yes. In this case, there 
is checked if there are mutation patterns or mutation 
agents dedicated to the classes "Book" and "Audio 
Tape". A mutation pattern dedicated to the classes book 
comprises for example the condition : "If the Product 
Type = "book" then mutate the Product into a Book". The 
system thus verifies if the found property value for the 
product type falls within the condition. For this purpose, 
the processor compares the property values stored in 
the memory with the condition of the mutation pattern. 
In this case the retrieved property for the product type 
is a "Book 0 . Consequently, a mutation occurs, wherein 
the class of the entity becomes "Book" and wherein the 
system will retrieve the additional property values per- 
taining to the class "Book". 



In particular, retrieving the additional property val- 
ues is again performed by one or several agents dedi- 
cated to this class. For example, an agent will be pro- 
vided for retrieving a book's author and title from a web 

5 site given the book's ID. Since the data will be retrieved 
from a web site, the agent type is in this case "Web". 
The address in the Origin field is in this case an URL of 
the web site where the data should be retrieved, the in- 
structions form in this case the steps required for ac- 

10 cessing a web page where the requested data is shown. 
This is performed by providing the ID number 
"93-21123" and assigning this number to a correspond- 
ing parameter on the web site, for example LCCN 
Number. The agent further comprises agent parame- 

15 ters, by means of which pattern matching is performed, 
wherein the property values are extracted from web con- 
tent by applying regular expressions, a known technique 
i.a. from "Mastering Regular Expressions" by Jeffrey E. 
F. Friedl, January 1997. For example the title property 

20 value could be found by searching on the page the ex- 
pression "TITLE : " and looking for a series of words after 
the expression and located between spaces. It will be 
clear that this technique is applicable to all web pages 
having a predetermined structured presentation of the 

25 data. The ID is for example mentioned after the expres- 
sion "LCCN NUMBER :" and the author after the expres- 
sion "Author/Other Name :". In the example given, the 
following additional property values are retrieved by the 
system : "War & Peace" as title and "Tolstoy, Leo" as 

30 author. 

Another agent could for example be provided for 
finding books chapters in a Telnet site given the book's 
ID. A further agent could be provided for accessing a 
relational database where book reviews are gathered 

35 from multiple sources, given a book's title and author. It 
should also be clear that the agents dedicated to a class 
to which the dependent class is hierarchically linked are 
also used. In this case, agents dedicated to the class 
products have already been processed, since book is a 

40 particular product and the user input the class "product" 
in his query. Now, the system has retrieved additional 
data, i.e. additional property values such as the title of 
the book, the author, reviews and chapters. This addi- 
tional data is supplied to the user, although he had re- 

45 quested data relating to a product. The answer to the 
request of the user is automatically completed by the 
system according to the present invention with addition- 
al data which was unexpected by the user. 

When several agents are provided for retrieving, 

so from different data sources, property values that should 
correspond, it may occur that some property values re- 
trieve are not equal to each other. For example, a cus- 
tomer's telephone number may be recorded differently 
in two data sources, or there might be three different 

55 authors for the same book title. In the first case, it is 
probable that the same customer has two phone num- 
bers (an inconsistency), in the second case, we may be 
dealing with three altogether different books (an ambi- 
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guity). 

Inconsistencies and ambiguities are unavoidable 
when integrating multiple data sources that were not 
conceived together and that may not even be managed 
by the same organisation. It is an object to deal in an 
appropriate way with ambiguities and inconsistencies 
within data. The manner in which the system according 
to the invention deals with those problems will be ex- 
plained by means of an example. 

Assume that agents are looking for a Person named 
Bob Smith. An agent A looks for a person's address giv- 
en the person's name. Two agents B and C look for a 
person' age given the person's name, each agent tar- 
geting a separate data source. This example is illustrat- 
ed in Figure 7. 

The agent A returns with not one but two "Bob 
Smith", one living in New York and the other in Newark. 
The question is,: Are we looking at two Bob Smith or only 
one but with a conflicting address? The answer depends 
on how much we irusl agent A to be accurate or, in other 
words, how much we trust its data source to return cor- 
rect addresses. For this purpose, a reliability or confi- 
dence parameter 227-B is assigned to the agent. Let's 
say we trust agent A for 1 00%. Then we have no choice 
but to see two Bob Smith and two entities are thus 
shown to the user. In case agent A has a confidence 
parameter of only 10%, then the system will show only 
one entity showing two possibilities for a property value, 
e.g. "New York OR Newark". 

Assume now agent A has a 100% reliability param- 
eter. Agent B and C for the Bob Smith in New York obtain 
his age. Both agree that it is 35. However agents B and 
C for the Bob Smith in Newark disagree about his age. 
Agent B indicates 24 and agent C 27. Are we looking at 
two Bob Smith living in Newark? In this case : Agents B 
and C have been declared as fallible. That they disagree 
is not sufficient grounds to see two separate Bob Smith 
living in Newark; so we simply record the fact that there 
is a "conflict of opinion* between data sources about the 
age the Bob Smith living in Newark. Because of ambi- 
guities and inconsistencies, a request to the system ac- 
cording to the invention to find an entity may end up re- 
turning more than one entity, with some "conflicts of 
opinion" about some of them. When this occurs, the user 
is presented with a display using the generic template 
239-5 for the requested view, e.g. a Web page, that 
gives a choice between these entities and highlights 
conflicts. 

In case agents B and C have substantially a same 
reliability parameter, which is relatively low, for example 
10%, then one entity will be presented to the user with 
an indication of two property values for the age : "24 OR 
27", such as illustrated in Figure 7. In case agents Band 
C have substantially the same reliability parameter, 
which is relatively high, for example 90%, then the sys- 
tems interprets that there are two distinct entities as be- 
ing two separate entities which will be presented to the 
user, each with its own age. In case agent B is substan- 



tially more reliable than agent C, for example agent B is 
at least 25 % more reliable than agent C ; then the sys- 
tem will rely on the property value retrieved by agent B, 
i.e. 24, and only the entity retrieved having this value 
5 will be presented to the user. 

Consequently, by providing a reliability parameter 
to the agents, the system interprets inconsistencies and 
ambiguities in property values, filters out unreliable 
property values and/or presents it in an appropriate 
10 fashion to the user. It should be noted that this provision 
of a reliability parameter could also be applied in other 
systems, in particular in systems without mutation 
means, and in general to any retrieving system provided 
for retrieving data from one or a plurality ol data sources. 
is Referring to Figure 4 : there is shown a dependent 
class "Best-seller 0 dependent from the class "Book". 
Now that the product requested by the user has been 
determined by the system as being a book, the system 
will further verify if the found entity should not further be 
20 mutated to the class "Best-seller". A mutation agent, i. 
e. an agent the mutator field 227-12 of which indicating 
that the agent is a mutation agent, which agent is dedi- 
cated to the class "Best-seller" is for example provided 
for accessing an external database or web site compris- 
es ing a best-seller list. Based for example on the book's 
title and the author, the agent will search, in the same 
manner as explained hereinabove, in the addressed da- 
ta source for the requested data. If the agent finds the 
requested book in the database, this means that the en- 
30 tity is a best-seller and the found entity is mutated to the 
class "Best-seller" as explained hereinabove. On the 
other hand, if the requested entity is not present in the 
best-seller data source, for example the agent receives 
a message such as "Could not be located", this signifies 
35 that the book is not a best-seller and therefore a muta- 
tion will not be performed. 

The example of the mutation pattern described 
hereinabove had a single value condition with an oper- 
ator "equal to". In general, it should be noted that all 
40 types of conditions are conceivable, with all types of op- 
erators such as "larger than", "between ... and ...". A list 
of single values is also conceivable. A mutation pattern 
could also have as condition "If all the other mutation 
patterns from the same level fail, then mutate to this de- 
45 pendent class". Such a mutation pattern signifies that 
the class to which the dependent classes of that level 
are hierarchically linked, is an abstract class, i.e. a class 
for which comprise no entities or instances. In the ex- 
ample given, if the store only sells books and audio 
50 tapes, the product class could then be an abstract class, 
since every entity is either a book or an audio tape. The 
mutation pattern for audio tape would be "If product type 
is not a book then mutate to audio tape class". 

A further aspect of the present invention is the vis- 
55 ualisation of the retrieved entities : in particular which 
property values are presented to the user based on its 
request. In the given example, the user has input in its 
query : "View=Customer", wherein all the found proper- 
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ties, except the supplier would be shown to the user. 
Another view could for example be a view for the staff, 
which view would require a password and provide in ad- 
dition to the property values mentioned (including the 
supplier property value) an indication of the stock of the 
product in the store. An additional agent or above men- 
tioned agent provided for retrieving the supplier and the 
type would be provided for retrieving in the internal da- 
tabase of the store, the numbers in stock of the request- 
ed product. 

Based on the requested view, corresponding to 
views name 239-2, and the requested class correspond- 
ing to class name 225-2, a dedicated class view 233 is 
determined by the system, having a dedicated template 
233-4. The content field 235-6 of the template table 235 
will supply the instructions for producing the requested 
view to a user. 

In general, once an entity has been recovered from 
the data sources it can be shown to the user who re- 
quested it. How Ihe entity is shown and how much of it 
is shown depends on the template that's used to gener- 
ate the presentation. Each template is dedicated to a 
class. A dependent class can inherit presentations from 
its classes from which it depends or can define its own 
templates. 

There are different kinds of templates, including : 

a page template to display an entity as a full page, 
for example, a Book page will show the book's title, 
author, price, availability etc.; 
an object template to display a summary of an entity 
in the page of another related entity, for example, a 
Book page would also show a list of its Reviews, 
each one summarized as a few lines and displayed 
using their object template; and 
a link template to display an attribute value, in par- 
ticular a hyperlink to an entity, for example, the sum- 
mary of a Review listed in a Book page would in- 
clude a hyperlink to the Review page where the full 
review can be read. 

A user display, in particular a web page, is con- 
structed on the fly from the templates. Each template is 
in fact a parameterised web page or VRML scene or oth- 
er presentation to a user. The blanks are filled by the 
values of the entity's attributes and content properties 
before display. When the value filling a "blank" is a ref- 
erence to another entity, then a hyperlink to that entity 
is automatically inserted. Hyperlinks are thus always 
correct and current, reflecting the data in the data sourc- 
es at the time of the request. 

If no template for a view on a class is defined (or 
inherited) for a given group of users, then no user be- 
longing to that group can see entities of that class. For 
example, there would be no views defined on the class 
Inventory for customers, meaning that customers could 
not peruse the Inventory. If an attribute of a class is not 
shown in a template for a given group, then no member 



of that group can see the value of that attribute. For ex- 
ample, the views for class Employee would include the 
Salary attribute only for the Manager group (meaning 
that only managers can see employee salaries). 

5 Between the moment an user requests to view an 

entity and the moment that entity is viewed for example 
as a Web page or a VRML scene or other presentation, 
a lot can happen as the relevant agents access data 
sources, triggering further agents until eventually all ac- 

10 tivated agents are done. Instead of waiting for all agents 
to have completed before displaying a Web page, a 
more dynamic approach may preferably be applied, a 
technique which is known as "server push", showing a 
Web page as soon as some data is available about the 

is requested entity and then refreshing the page automat- 
ically when new data is retrieved. In particular, when mu- 
tation is applied, the user will first see data relating to 
the requested class and upon refreshing, the user will 
also see the additional property values. This way, the 

20 user does not have to wait too long to get a feedback 
and may elect to follow a hyperlink before the entity is 
completely shown and while the incomplete page is 
waiting to be refreshed with additional property values. 
In a preferred embodiment, there is first checked 

25 which view is requested by the user and determined 
which properties should be supplied to the user. Based 
on this determination, only the agents required for the 
requested view are triggered, in order to supply more 
quickly the requested data to the user. 

30 A further aspect of the present invention relates to 
supplying the results of a query input by the user in a 
more structured manner. Queries supplied tothe system 
may lead in a large number of entities to be retrieved 
and presented to the user. With known systems, the us- 

35 er would be confronted with long lists of results, in par- 
ticular hyperlinks, to scroll through. 

The system according to the present invention 
takes advantage of the fact that the retrieved entities are 
dedicated to a structured model and thus that it has 

40 some understanding of entities. It is thus possible to or- 
ganise long lists of entities. All entities belong to a class 
with defined properties. Using that knowledge, the sys- 
tem takes a long list and splits into smaller lists. Each 
smaller list represents entities falling within some range 

45 tor a property value. For example, for a big list of Em- 
ployees, the system could break the list down according 
to employee ID. A first sub-list would contain references 
to employees with IDs less than 236 and the other small- 
er list would contain references to employees with IDs 

50 greater than 342. This example is illustrated in Figure 8. 

Since there is more than one property definition that 
can be used to create smaller lists, the system offers 
alternate subdivisions of the oversized content This is 
in particular performed for each of the property values 

55 that may be viewed by the user. As illustrated in Figure 
8, smaller lists are created for the first name, last name, 
city and state. 

If the smaller sub-list is still too large for comfort, the 
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system applies the same operation again on the sub- 
list, until the user reaches a list small enough to be laid 
out in full. This is performed automatically for example 
by assigning to the system a predetermined maximum 
number of entities that the sub-list may not be exceeded. 

Sometimes the amount of data that would be re- 
turned by an agent is so large that the system can only 
accept some of it from the data source and must discard 
the rest. Imagine what could happen if an agent returned 
a million references to Customers. The manageable 
portion that is accepted by the system is displayed using 
the same technique. As the user accesses restricted 
subsets of the original list, a more specific query is sent, 
yielding a smaller number of references. Again that 
smaller number, for example 100,000, may still be too 
large to be all taken in by the system. Eventually though, 
when the user has navigated to a narrow enough sub- 
set, the highly constrained query will return a complete 
yet manageable set of answers which can all be accept- 
ed and displayed by the system according to the present 
invention. 

Consequently, such a subdivision of the results or 
automatic indexing provides to the user a logical struc- 
ture of the retrieved entities, wherein the user can select 
a range. It should be noted that this provision could also 
be applied in other systems, in particular in systems 
without mutation means, and in general to any display- 
ing system for displaying large sets of data. 

In summary, when a user supplies a query to the 
user, the following steps are performed, according to a 
preferred embodiment of the present invention: 

1. The query is received by the interface and sup- 
plied to the processor 

2. If required, the user is asked to enter a user ID 
and a password for authentication, in particular 
when the requested view is a password protected 
view 

3. The query is processed by the system 

4. A plurality of data sources, addressed by the 
agents, are accessed to retrieve data pertaining to 
the requested entities, which data is mapped into 
property values as defined in the agent parameters 
of the agent. 

5. The found entities are presented to the user ac- 
cording using templates dedicated to the requested 
view. In particular, this step may be performed be- 
fore the previous step has been finished : in such a 
manner that the page presented to the user is dy- 
namically updated when more property values are 
retrieved. In case the number of results is too large, 
then the list of results is subdivided in smaller list 
indexed according to several property values and 
presented to the user. The user may select one of 
these smaller lists. 

6. Meanwhile, there is checked if mutation of each 
found entity should occur, using mutation patterns 
and mutation agents. If mutation occurs, additional 
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property values are retrieved and presented to the 
user, by dynamically updating the users screen. 
7. A new query may be input by the user to the sys- 
tem, in particular by selecting a link in the presen- 
tation supplied to the user. 

The system according to the present invention im- 
proves the manner in which data is extracted from data 
sources, integrated into a model and presented to the 
user, in particular when the data has to be retrieved from 
a plurality of data sources which may have different for- 
mats. 



is Claims 

1. An entity retrieving system connectable to at least 
one data source, said system having a memory into 
which a plurality of classes are stored, each class 
20 defining the structure of said entities, said structure 
comprising a plurality of property definitions, each 
property definition identifying property values to be 
retrieved dedicated to said property definition, said 
property values being stored in said data sources, 
25 said system further comprising an interface and a 
processor connected to each other, wherein 

(a) said classes comprise at least one depend- 
ent class hierarchically linked to at least one 
other class, said dependent class comprising 
additional property definitions specifying addi- 
tional property values, in addition to the prop- 
erty values of the classes from which it de- 
pends, 

(b) said interface is provided for receiving a 
query and supplying said query to said proces- 
sor, said query comprising an identifier for iden- 
tifying a particular class and at least one of said 
property values, 

(c) said processor being provided, under con- 
trol of said query, for selecting, among said 
classes, said particular class dedicated to said 
identifier, and 

(d) said interlace is further provided 

i) for accessing said data sources, under 
control of said processor, 

ii) for retrieving property values pertaining 
to at least one particular entity that corn- 
so prise said at least one of said property val- 
ues and 

iii) for outputting the retrieved entities, 

characterised in that 
ss said system further comprises mutation means pro- 
vided for cooperating with said memory, said proc- 
essor and said interface and for establishing, for 
each particular entity to be retrieved, if said partic- 
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ular entity pertains to one of said dependent classes 
of said selected particular class, and retrieving, up- 
on establishing that said particular entity pertains to 
one of said dependent classes of said selected par- 
ticular class, said additional properties of said de- s 
pendent class. 

2. A system according to claim 1 , wherein 

(a) said mutation means comprise a mutation io 
pattern dedicated to said dependent class, said 
mutation pattern comprising at least one condi- 
tion, each condition assigning at least one pre- 
determined property value range to one of said 
property definitions of said class to which said is 
dependent class is hierarchically linked, and 

(b) said mutation means are further provided 
for establishing if said particular entity pertains 
to said dependent class by verifying if the prop- 
erty value dedicated to said property definition 20 
of said particular entity falls within said prede- 
termined property value ranges. 

3. A system according to claim 1 or 2, into which mem- 
ory agents are stored, each agent being dedicated 25 
to at least one of said classes, each agent being 
provided for cooperating with said interface for ac- 
cessing at least one particular property value per- 
taining to said particular entity of said class, each 
agent comprising : 30 

(a) an address for addressing one of said data 
sources Irom which said particular property val- 
ues are to be retrieved, 

(b) a series of instructions indicating which data 35 
from the addressed data source are to be re- 
trieved by said agent, 

(c) at least one agent parameter for assigning, 
for each property value to be retrieved, a por- 
tion of said data to one of said property defini- 40 
tions. 



6. A system according to anyone of the claims 3 to 5, 
wherein said agent comprises a speciality indicator 
for indicating the type of the addressed data source. 

7. A system according to anyone of the claims 3 to 6, 
wherein said agent comprises an authoritative indi- 
cator for indicating that if the property values re- 
trieved by said agent are empty, then an indication 
that the entity does not exist is shown to a user of 
the system. 

8. A system according to anyone of the preceding 
claims, said system further comprising means for 
displaying the retrieved entities to a user, said sys- 
tem further comprises means for generating, upon 
receipt of said retrieved entities, at least one list, 
each list comprising a plurality of property value 
ranges for subdividing said retrieved entities, and 
said interface is further provided for enabling said 
user to select one property value range within one 
of said lists. 

9. A system according to anyone of the preceding 
claims, into which memory a plurality of models are 
stored, wherein each of said classes are assigned 
to one of said models. 

10. A method for retrieving entities by using a system 
according to anyone of the preceding claims com- 
prising the steps of: 

(a) receiving said query and supplying said 
query to a processor; 

(b) selecting among said classes, said particu- 
lar class dedicated to said identifier, 

(c) accessing said data sources, under control 
of said processor, 

(d) retrieving property values pertaining to at 
least one particular entity that comprise said at 
least one of said property values and 

(e) outputting the retrieved entities, 



4. A system according to claim 3, wherein said muta- 
tion means are further provided 

45 

(a) for establishing if said agent comprises a 
mutation indicator indicating that said agent is 
a mutation agent, and 

(b) for establishing if said particular entity per- 
tains to said dependent class by verifying if said so 
agent has established that said at feast one par- 
ticular property value pertaining to said partic- 
ular entity is present, upon establishing that 
said agent comprises said mutation indicator. 

ss 

5. A system according to claim 3 or 4, wherein a reli- 
ability parameter is assigned to said agent. 



characterised in that said method lurther comprises 
the step of 

(f) establishing, for each particular entity to be 
retrieved, if said particular entity pertains to one 
of said dependent classes of said selected par- 
ticular class, and 

(g) retrieving, upon establishing that said par- 
ticular entity pertains to one of said dependent 
classes of said selected particular class, said 
additional properties of said dependent class. 
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